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(57) ABSTRACT 

In a method of fair queue servicing at a queuing point in a 
multi-service class packet switched network, incoming 
packets are received in buffers and outgoing packets are 
scheduled by a weighted fair queue scheduler. Real-time 
information of buffer usage along with the minimum band- 
width requirement is used to dynamically modify the 
weights of the weighted fair queue scheduler. 
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Ts: Sampling interval 

Wi: service weight. Number of cells to be served in T's for output queue 



From CAC and the service class manager. 

min_ Wi: minimum service weight table 
TQSi: Target Queue Size table 
L: Queue Service Priority List (Sorted) 



Sorted 
List L 



Priority 
Order 



Q 1 



Q2 



Q n 



From the Queue Growth monitor (every Ts): 

Qi: queue size at the end of Ts. 
Ai: number of arrivals during previous Ts 
AQi: change of queue size during previous Ts 



Reserved Weight: 
Imin Wi 



Shared Weight Pool: 
WS = Ts-Zmin Wi 



SWM updates All Queue Weights after one Ts: 
(see Figure 4 for detailed algorithm 

(1) Queue growth rate AQil ..... 

arrival rate Ai fAWi 
queue size Qi J 

(2) Wi = min_ Wi, guarantees minimum weight, 
provides protection for high priority queues 

(3) Further allocate the A Wi to Wi in the priority 
order, specified by list L: 

Wi = wi+AWi, if Shared Weight Pool isn't empty. 
Wi = min_Wi, otherwise (Ws = o). 



FIG. 3 
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From the Queue Growth monitor : 
Qi: queue size at the end of Ts. 
Ai: number of arrivals (luring previous Ts 
Qi: change of queue size during previous Ts 



20 



Weights Re- calculations perTs 
YES 



22 

4- 



ueue Growth Positive ? 
AQi > 0 ? 



NO 



Conservatively adjust service weight to 

bring queue size to TQSi. 
Wi = max {( Ai + Qi + Qi - TQSi, min_ Wi 





23 


Adjust service to bring queue 


size to TQSi. 




Wi = max {( Ai + Qi - TQSi, min.Wi} 




NO 



1 




Wi = min Wi + Ws 
Ws + O 





Wi = min_Wi+AWi 
Ws = Ws-AWi 



28 



31 

-4- 



FIG.4 



Update weight table to be used by WFQ in the next Ts 
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FAIR QUEUE SERVICING USING DYNAMIC 
WEIGHTS (DWFQ) 

This invention relates to the field of telecommunications, 
and more particularly to a method of fair queue servicing in 
asynchronous data networks, such as Asynchronous Transfer 
Mode (ATM) networks or more generally any packet 
switched network that supports more than one class of 
service. 

The use of ATM by a continually increasing number of 
applications is driving a requirement to increase the number 
of service classes and to allow more flexibility in the service 
offerings. To support the application requirements, the ATM 
Forum is adding new service categories in new releases of 
ATM specifications. Furthermore, network providers are 
looking for the flexibility of defining multiple service classes 
for a given service category. The service classes are differ- 
entiated by their Quality-Of-Service requirements (QoS). 
The QoS requirements are configurable in accordance with 
a bi-dimensional matrix describing loss and delay. The delay 
jitter is another factor which needs to be bounded for some 
service classes. 

Previously, three service categories were supported on an 
ATM network element, namely constant bit rate (CBR), 
variable bit rate (VBR) and unspecified bit rate (UBR). The 
CBR service is the only service that guarantees a bound on 
delay. It is used for time sensitive data, such as voice and 
video. 

These various services can be supported by traditional 
exhaustive round-robin queuing among two priority queues. 
However, this simple technique cannot be used when the 
number of queues increases beyond two, because of the high 
potential of starvation for lower priority queues. 
Furthermore, the exhaustive round robin can only guarantee 
bounds on delay and delay variation for the highest priority 
queue. The support of multiple service class in an ATM 
switching product or multiplexer requires a minimum of one 
queue per class. 

A queue scheduling algorithm, Weighted Fair Queuing 
(WFQ), has been recently proposed in the literature (see S. 
Golestani, A self -clocked Fair Queuing scheme for broad- 
band applications. INFOCOM 1994. June 1994). 

This scheduling scheme allows any number queues 
(service classes) to be serviced, while providing fair and 
work conserving access to bandwidth. One of the key 
features of WFQ is that the CDV (Cell Delay Variation) is 
bounded for any service class, as long as it is given a 
minimum weight. 

This proposed scheme can be implemented in ATM 
products, However, it has not been determined how to set the 
servicing weights efficiently to take into account the 
dynamically changing bandwidth requirement of each ser- 
vice class (connection addition/removal, ABR flow control, 
Early packet Discard). 

An object of the invention is to provide a framework that 
ensures that the weights are set appropriately to guarantee 
the desired Quality of Service and modified in real-time to 
ensure that the dynamic allocation of bandwidth across the 
classes is optimized. 

According to the present invention there is provided a 
method of fair queue servicing at a queuing point in a 
multi-service class packet switched network, wherein 
incoming packets are received in buffers and outgoing 
packets are scheduled by a weighted fair queue scheduler 
characterized in that real-time information of buffer usage 
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along with the minimum bandwidth requirement is used to 
dynamically modify the weights of the weighted fair queue 
scheduler. 

Preferably the minimum bandwidth requirement is 
5 extracted during connection admission control. 

The method is particularly suitable for use in ATM 
networks. 

The DWFQ (Dynamic Weighted Fair Queuing) can be 
implemented at any queuing point which arbitrates servicing 

10 between n queues (n^2). 

The invention also provides a fair queue servicing 
arrangement in a multi-service class packet switched 
network, comprising a weighted fair queuing controller, and 

15 buffer means for receiving incoming packets in queues, 
characterized in that further comprises means for monitoring 
buffer usage for each queue, means for determining the 
bandwidth requirements of each class of service, and a 
service weights manager for dynamically modifying the 

20 weights of said weighted fair queuing controller means in 
response to said buffer usage and bandwidth requirements. 

Preferably, the means for monitoring buffer usage a 
queue growth monitor which performs real-time estimation 
of the queue growth in said buffer means. 

25 The invention will now be described in more detail, by 
way of example only, with reference to the accompanying 
drawings, in which 

FIG. 1 is a diagram depicting the high level queuing 
scheme at an ATM switch ; 

30 FIG. 2 shows the information provided by the Queue 
Growth Monitor; 

FIG. 3 illustrates the data flow between the key compo- 
nents of the system and the action of the Service Weight 

35 Manager (SWM); and 

FIG. 4 describes the process performed by the SWM. 
Referring now to FIG. 1, ATM cells 2 arrive at buffer 1 
and are placed in queues I 1 , l 2 , . . . 1". From there the cells 
are passed to a weighted fair queuing unit 3. The buffer 1 is 

40 also connected to a queue growth monitor 4, which in turn 
is connected to congestion control unit 5, congestion ana- 
lyzer 6, and connection admission controller 8, which in turn 
is connected to SVC & PVC (Switched Virtual Circuit and 
Permanent Virtual Circuit) connection handling unit 7, and 

45 service class manager 10. Queue growth monitor 4, connec- 
tion admission controller 8 and service class manager 9 are 
connected to service weights manager 9, which is connected 
to weighted fair queuing scheduler 3. 

The key element of the Dynamic Weighted Fair Queuing 

50 (DWFQ) scheme is the service weight manager (SWM) 9, 
which dynamically modifies the service weights to be used 
by the WFQ Scheduler 3. It uses real-time information from 
the service class manager 10, the connection admission 
controller 8, and the Queue growth monitor 4. 

55 The service class manager 10 configures the service 
classes. A service class is configured with a given value of 
delay (CTD-Cell Transfer Delay) and loss (CLR-Cell Ratio 
Loss) requirements. These parameters represent the maxi- 
mum nodal delay and loss allowed in order to meet the 

60 end-to-end QoS requirements of the connection. The service 
classes are mapped into a priority table as exemplified in 
Table 1. The priority table is used later by the service weight 
manager to allocate remaining bandwidth. The priority table 
is updated when a service class definition is modified. The 

65 service class manager also dictates which traffic descriptors 
are used to compute the minimum bandwidth required by a 
connection of a given class. 
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TABLE 1 



Example 


of a Queue 


Service Priority Mapping. 


CTD 


CLR 


100 fa 


500 jjs None 


io-° 


1 


3 6 


ltr 7 


2 


5 8 


10-* 


4 


7 9 



The connection admission controller (CAC) 8 computes 
the minimum bandwidth required for each service class. The 
minimum bandwidth is updated each time a connection of a 
given class is established or disconnected, based on its traffic 35 
descriptor. 

Table 2 shows a typical example of which traffic descrip- 
tors that can be used to compute the minimum bandwidth for 
each basic service category relative to the queue service rate 
(SR). The CAC 8 communicates the minimum Weight table 20 
to the SWM every time the value of the minimum weights 
have changed by a factor of 



TABLE 2 





Example of minimum weight table. 


Queue; 


Category 


min_Wi 


Qi 


CBR 


(2 PCR)/SR 


Q 2 


RT-VBR 


(Z SCR)/SR 


Q 3 


NRT- 


(Z SCR)/SR 




VBR 




Q4 


UBR 


0 



The CTD is further taken into account in the target queue 
size (TQS) table, which is the maximum queue size allowed 
to limit the CTD. An example of TQS t - computation is shown 
in Table 3, for typical service categories. A zero TQS 
indicates that the queue can grow without limitation. This 
table is computed by the CAC. 



TABLE 2 



Example of ; 


a target queue 


size computation. 


Queue; 


Category 


TQSi 


Qi 


CBR 


CTD/min_Wi 


Q 2 


RT-VBR 


CTD/min_Wi 


Q 3 


NRT- 


0 




VBR 




Q 4 


UBR 


0 



The Queue Growth Monitor (QGM) 4 performs real-time 
estimation of the queue growth every T, cell slots (sampling 
interval). The information provided by the Queue Growth 
monitor 4 to the SWM 9 consists of AQi, the Queue Growth 
Rate of output queue i during an interval of duration Ts, Qi, 
the length of output queue i at the sampling time, and Ai, the 
arrival rate during the same interval of time. 

The corresponding parameters: queue size Qi, queue 
growth AQi, number of arrivals Ai are collected or each 
queue by the QGM 4 for each Ts interval. From these 
parameters, auxiliary parameters such as average arrival rate 
Xi and service rate /a can be derived by the SWM 9: 

X,-: average arrival rate, X^A^+T,. 

f^: average service rate, /i^S.+T,, where S-Af-AQ,- is the 
number of cells served during T,. 

FIG. 2 shows the information provided by the Queue 
Growth Monitor 4. Using this information for the CAC 8, 



the service class manager 9 and the queue growth monitor 4, 
the SWM computes the service eight for each queue i (W^) 
to be used during the next sampling interval. 

As can be seen in FIG. 3 which shows the data flow 
5 between the key components of the system and the action of 
the SWM 9, the queue weights, Wi, are updated using 
information provided by the Queue Growth monitor 4. 

If "kg denotes the arrival rate of cells in queue i in the 
coming T s interval, then ideally, the target service rate ft can 
10 be calculated as: (a-^T^Q-TQS,. This means at the end 
of next Ts interval, the queue size Qi will reach the target 
queue size TQSi. On the assumption that X,- remains 
unchanged from \., the service weight W—^-T, can be 
approximated as 



25 



30 



35 



45 



50 



55 



60 



65 



WrwT^T^rTQS^Ai+QrTQSi. 

However, the assumption on the stable arrival rate may 
not hold, and also the actual number of serviced cells Si 
could be less than Wi; therefore a more conservative 
approach is AQ^O, then Q.+AQ^, the predicted queue size at 
the end of the next Ts interval, is used to calculate the target 
service rate and weight. That is: 

(Hr^Ti-QfitiQrTQSi and W^ T.+QMQrTQSrAi+Q^Qr 
TQSi 

The detailed algorithm performed by the service weights 
manager 9 is shown in FIG. 4. The queue size Q ( . at the end 
of each interval T^, the number of arrivals A,- during the 
previous interval T f , and the change in queue size AQ f are 
input at step 20. Step 21 determines whether the queue 
growth is positive: if yes, the service weight W ( - is conser- 
vatively adjusted to bring the queue size to TQSi at step 22; 
if no, the service weight W t - is adjusted to bring the queue 
size to TQSi at step 23. The difference AW is determined in 
step 24. 

Step 25 determines whether the shared weights pool is 
empty: if yes, Wi is set to min_Wi in step 26; if no, step 27 
determines whether Ws^ AW t -: if yes, step 28 sets W t omin_ 
W ( .+AW ( - and W^W^+AW,-; if no, step 29 sets W~min_ 
W.+W, and W,-0. 

Step 30 runs through all the Wi in the ordered list L and 
step 31 updates the weight table used by the Weighted Fair 
Queuing scheduler 3. 

The described technique complies with ITU and ATM 
forum standards and can be applied to an) switching equip- 
ment which supports more than a single service class of 
service. 

What is claimed is: 

1. A method of fair queue servicing at a queuing point in 
a multi-service class packet switched network, comprising 
the steps of: 

enqueuing incoming packets in buffers associated with 
respective service classes; 

transmitting outgoing packets from said buffers in accor- 
dance with a schedule determined by weights used by 
a weighted fair queue scheduler; 

determining in real-time buffer usage and a minimum 
bandwidth requirement for each service class; and 

dynamically modifying the weights used by said weighted 
fair queue scheduler in real-time so as to cause buffer 
queue size to move toward a predetermined target 
value. 

2. A method as claimed in claim 1, wherein the minimum 
bandwidth requirement for at least one service class is 
determined during connection admission control of a con- 
nection to said queuing point. 
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3. A method as claimed in claim 1, wherein said weights 
are also modified in accordance with real-time service class 
information. 

4. A method as claimed in claim 1, wherein buffer usage 
is monitored by a queue growth monitor, said queue growth 
monitor performing real-time estimation of queue growth 
every sampling interval T s . 

5. A method as claimed in claim 1, wherein said packet 
switched network is an ATM network and said packets are 
ATM cells. 

6. A method as claimed in claim 1, wherein the weights of 
the weighted fair queue scheduler are modified by carrying 
out the following steps during a series of sampling intervals: 

a) determine whether the queue growth is positive, and if 
so adjust the weight to bring the queue size to said 
predetermined target value TQSi in accordance with 
the relationship Wi=max{Ai+Qi+AQi-TQsi), min_ 



10 



15 



Wi}, wherein Wi is the weight, Ai is the number of 
arrivals during a previous sampling period Ts, Qi is the 
queue size at the end of the sampling period Ts, AQi is 
the change in queue size during the sampling period Ts, 
or else if the queue growth is not positive, adjusting the 
weight to bring the queue size to the predetermined 
target value TQSi in accordance with the relationship 
Wi=max{Ai+Qi-TQsi), min_Wi}; and 
b) determining the difference AWi=Wi-min_Wi, where 

Wi is determined in step a). 
7. A method as claimed in claim 1, wherein cell transfer 
delay cell loss ratio requirements for each class of service 
are stored and taken into account in dynamically modifying 
the weights of said weighted fair queue scheduler. 
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